Back Propagation is Sensitive to Initial Conditions
نویسندگان
چکیده
This paper explores the effect of initial weight selection on feed-forward networks learning simple functions with the back-propagation technique. We first demonstrate, through the use of Monte Carlo techniques, that the magnitude of the initial condition vector (in weight space) is a very significant parameter in convergence time variability. In order to further understand this result, additional deterministic experiments were performed. The results of these experiments demonstrate the extreme sensitivity of back propagation to initial weight configuration. Back Propagation is Sensitive to Initial Conditions John F. Kolen Jordan B. Pollack Laboratory for Artificial Intelligence Research Computer and Information Science Department The Ohio State University Columbus, Ohio 43210, USA [email protected], [email protected]
منابع مشابه
On the use of back propagation and radial basis function neural networks in surface roughness prediction
Various artificial neural networks types are examined and compared for the prediction of surface roughness in manufacturing technology. The aim of the study is to evaluate different kinds of neural networks and observe their performance and applicability on the same problem. More specifically, feed-forward artificial neural networks are trained with three different back propagation algorithms, ...
متن کاملTorsional Surface Wave Propagation in Anisotropic Layer Sandwiched Between Heterogeneous Half-Space
The present paper studies the possibility of propagation of torsional surface waves in an inhomogeneous anisotropic layer lying between two heterogeneous half-spaces (upper and lower half-space). Both the half-spaces are assumed to be under compressive initial stress. The study reveals that under the assumed conditions, a torsional surface wave propagates in the medium. The dispersion relation ...
متن کاملReflection of Waves in a Rotating Transversely Isotropic Thermoelastic Half-space Under Initial Stress
The present paper concerns with the effect of initial stress on the propagation of plane waves in a rotating transversely isotropic medium in the context of thermoelasticity theory of GN theory of type-II and III. After solving the governing equations, three waves propagating in the medium are obtained. The fastest among them is a quasi-longitudinal wave. The slowest of them is a thermal wave. ...
متن کاملPredicting Depth and Path of Subsurface Crack Propagation at Gear Tooth Flank under Cyclic Contact Loading
In this paper, a two-dimensional computational model is proposed for predicting the initiation position and propagation path of subsurface crack of spur gear tooth flank. In order to simulate the contact of teeth, an equivalent model of two contacting cylinders is used. The problem is assumed to be under linear elastic fracture mechanic conditions and finite element method is used for numerical...
متن کاملPhysical modelling of caving propagation process and damage profile ahead of the cave-back
The cavability assessment of rock mass cavability and indicating the damage profile ahead of a cave-back is of great importance in the evaluation of a caving mine operation, which can influence all aspects of the mine operation. Due to the lack of access to the caved zones, our current knowledge about the damage profile in caved zones is very limited. Among the different approaches available, p...
متن کامل